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Abstract 

We show that the directed subdifferential introduced for differences 
of convex (DC) functions by Baier and Farkhi can be constructed 
from the directional derivative without using any information on the 
DC structure of the function. The new definition extends to a more 
general class of functions, which includes Lipschitz functions definable 
on o-minimal structure and quasidifferentiable functions. 
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1 Introduction 

The directed subdifferential was originally introduced in [3] for DC (difference 
of convex) functions as the difference of the Moreau-Rockafellar subdifferen- 
tials of two convex functions embedded in the space of directed sets [1, 2]. 
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Furthermore, as the directional derivative of any quasidifferentiable (QD) 
function is the difference of the support functions of two convex compacts, 
the directed sub differential was extended in [5, 6] to the class of quasidiffer- 
entiable (QD) functions. 

The directed sub differential enjoys exact calculus rules, and gives the 
same sharp optimality conditions as the Demyanov-Rubinov quasidifferential 
or the Dini subdifferential and superdifferential. In contrast to the quasidif- 
ferential which is an equivalence class of pairs of convex compact sets, the 
directed subdifferential, as a uniquely defined difference, does not depend 
on a chosen representating pair, which eliminates the 'inflation' in size when 
calculus rules are applied repeatedly. Moreover, one of the major challenges 
in quasidifferential calculus associated with the DC decomposition is not rel- 
evant for the directed subdifferential: in this work we show that the directed 
subdifferential can be constructed without any knowledge of the underlying 
DC structure. In fact, the function (or its directional derivative) does not 
even need to be DC. 

Here we extend the domain of definition of the directed subdifferential to 
a rather large class of funcions on M. n , essentially wider than QD functions. 
This class of functions includes all locally Lipschitz functions definable on 
o-minimal structure (see [10, 11, 15]). To our best knowledge, whether or 
not Lipschitz tame functions are DC constitutes an open problem. 

However, our main achievement is that the new construction does not re- 
quire any DC structure of the function or its directional derivative. What is 
only needed to calculate the directed subdifferential are (recursively) the 
directional derivatives of the function and of their restrictions to lower- 
dimensional affine sets. The directed subdifferential can be constructed for 
any n times uniformly directionally different iable function, which we call 'di- 
rected subdifferentiable'. The directed subdifferential is defined inductively 
in the dimension n, analogously to the inductive definition of directed sets. 

Let us note that other widely used subdifferentials can be evaluated via 
the directed subdifferential: Dini/Frechet, Michel- Penot, and, in some cases 
also, Clarke and Mordukhovich subdifferentials (see [4]). This together with 
the exact calculus rules for the directed subdifferential may help in practical 
applications where computing nonconvex subdifferentials is needed. 

The paper is organized as follows: in Section 2 we remind the basic ideas 
behind the Banach space of the directed sets and in Section 3 we briefly 
introduce the directed subdifferential, if a DC structure for the function or 
its directional derivative is known. To give the reader the flavour of our 
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results, and to explain our motivation, in Section 4 we demonstrate how 
to construct the directed subdifferential for DC functions without knowing 
the DC decomposition. Section 5 is devoted to 'directed subdifferentiable' 
functions and a rigorous definition of the directed subdifferential for such 
functions is given there, as well as caculus rules and one example of a directed 
different iable function which is not quasidifferentiable. 



2 Directed sets — a brief overview 

Here we only sketch the most important notions related to directed subdif- 
ferential. For more details and examples we refer the reader to [1, 2, 3, 5, 6]. 

We use the standard notation in the paper: by || • || we denote the Eu- 
clidean norm, and SVi-i is the (n — l)-dimensional sphere in W 1 . 

The directed sets and the embedding J n of convex compact sets in M n 
into the Banach space of directed sets are introduced in [1, 2] recursively 
in the dimension n. The definition of the directed set is motivated by the 
Minkowski duality between compact convex sets and their support functions 
which correspond to the first and the second component in the definition. 
Let C C R n be nonempty, convex and compact and let I G W 1 . The support 
function and respectively the supporting face of C in direction I are defined 
by 

5* (I, C) = max (I, c) , 

cec 

Y(l,C) = {yeC\(l,y)=5*(l,C)} = a rgm a x(l,c) . 

cSC 

Note that Y(-,C) is upper semicontinuous and for / = 0, Y(l,C) = C. By 
y(l,C) we denote any point of the set Y(l, C), and if the latter is a singleton 
(i.e. there is a unique supporting point), then Y(l,C) = {y(l,C)}. 

In one dimension, the directed embedded intervals are defined by the values 
of the support function in the two unit directions ±1. Given an interval 
[a, b] G M, its embedded image in the space of one dimensional directed space 

Kb] = Jx([a,b\) = (5*( V , [a,b])) v=±1 = (-a, b) (a < 6) . 

A general directed interval ~X\ = [c, d] = (— c, d) allows that c, d are 
arbitrary real numbers, even c > d is possible (see references in [1, 2]). 
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Linear operations on directed intervals are defined in a natural way and 
are motivated by the operations for vectors in IR 2 : for directed intervals [a, b] 
and [c, d] and any a, (3 G M 

a[a, b\ + (3\c, d] = [aa + /3c, ab + f3d] . (1) 

Definition 2.1. VFe ca// ^4 a directed set 

(i) in K ; i/ z's a directed interval. Its norm is \\ A ||i = max 

(ii) in M. n , n > 2, if there exist a continuous function a n : S n ~i — > K. 
and a uniformly bounded map having lower- dimensional directed sets 
as images A n _i : S n -\ — >■ V(M n ~ 1 ) with respect to \\ ■ || n -i- 

We denote ~/l = (A n _i(l), an(0)zes„-i an d define its norm as 

\\A*\\ := ||^|| n := max{ sup || ||„_i, max |a n (Z)|} . 

The set of all directed sets in M. n is denoted by V(M. n ). 

Observe that the space of directed sets is a Banach space (see [1, The- 
orem 4.15]). The linear operations are defined recursively, on the two compo- 
nents of the directed sets ~X = (A n _i(l), a n (l))i€S n -i> 



~A+F3:= (A n _i(Z) + 5 n _i(/), a n (l) + b n (l)) leSn ^ , 
A • ~t := (A • A~$, A • a n (l)) leSn ^ (AG 



1 _ ^ := ~% + (_^) = (A n _i(/jj - fi n _!(zi, a n (Z) - & n (f))z 6 



(2) 



The space of directed sets is hence a normed vector space with zero 



Od(r«) = (0v(js^),0)ies n -i (see [1, Proposition 4.14]). 

The embedding J n : C(M n ) — > V(R n ) of the convex sets in the space of 
directed sets which determines for every set A G C(M n ) its embedded image 
A G V(R n ) is defined as follows: 

(i) For n — 1, [a, b\ = Ji([a, b]) : = (—a, b). 
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(ii) For n > 2, ~2 = J n (A) := (j n ^(U n _ 1:l (Y(l, A))), 8* (I, A))^^, 

where J n _i(II n _i ; z(Y(i, A))) is an n — 1-dimensional image of the face 
Y(l, A), Tl n _ij(x) := it n -i,nRn,i{x) and 7r n _i in £ M( n_1 ) xn is the natural 
projection, i.e. 7r n _ 1)7l (xi, . . . ,x n _i,x n ) = . . . ,x„_i), and i? n>i is a 
fixed rotation for every I £ S n -\ satisfying 

R n j(l) = e n , i^spantf} 1 ) = spanje 1 , e 2 , . . . , e n ~ 1 } . (3) 

We also note that the embedding is positively linear by [1, Proposition 3.10 
and Theorem 4.17], i.e. 

J n {\A + nB) = XJ n (A) + fiJ n (B) (A, B £ C(R n ), A, /i > 0). (4) 

3 The directed subdifferential 
with known DC structure 

Before introducing the directed subdifferential, let us recall that the classical 
Moreau-Rockafellar convex subdifferential of a convex function / : W n — > R 
at x £ MJ 1 is a compact convex set 

df{x) := {s £ R n | Wy £ E" : (a, y - x) + /(s) < /(?/)} . (5) 

In the sequel, the Moreau-Rockafellar convex subdifferential of a sublinear 
function g at zero is denoted by dg instead of dg(0). 

Note that Y(l,C) equals the subdifferential of the support function of C 
at I [17, Corollary 23.5.3]. 

It is well-known (see e.g. [14, Chap. VI, Definition 1.1.4 and Example 3.1, 
(3.1)]) that 

8*(l,df(x)) = f\x;l), (6) 
d6*{-,A)(l)=Y(l,A) {AeC(R n )), (7) 

and hence, 

df'(x;.)(l)=Y(l,df(x)). (8) 
where f'(x; I) is the (Dini) directional derivative of / at x in a direction I, 

/■(»-, o= Km n*+ti)-m 

J y ' ' t^o+ t 
5 



The following statement is [12, Proposition 3.1 from Chap. 1.3] and is 
needed later for proving the closure of arithmetic operations for directed 
subdifferentiable functions: 

Remark 3.1. Let fx, f% : R n — > R be directionally differentiable at x G R n . 
Then their sum, product and quotient (if f2{%) 7^ 0) ar ^ o/so directionally 
differentiable at this point and the following formulas hold for a, j3 E R: 

{afi + Pf 2 )'(x; I) = af[(x; I) + p&(x; I) , 

(fi ■ h)'{x\ I) = fi{x)fi(x; I) + f2(x)f[(x; I) , 

!l)\ x .[)- h^)f^i)-f2{x)f[{x ] i) 



h) V ' ' [f2(xW 

A similar closedness property with respect to min/max operations is given 
in [12, Corollary 3.2 in Sect. 1.3]: 

Remark 3.2. Let fi : R n — > R, % G I — {1,2, have finite Dini 

directional derivatives at x G R n for all I G 5 n -i- Then the pointwise mini- 
mum and pointwise maximum functions f max (-) = rciaxj g / /j(-) and / m m(") = 
minj g //j(-) are also Dini directionally differentiable at x with 

fL*.( x \ = max fi{x; /); f^x; I) = min ft(x; I) , 
iei(x) i&j(x) 

where I(x) = {i G I 1 fi(x) = / max (V)} ; J(x) = {i G / 1 fi(x) = f m i n (x)}. 

Clearly, we can embed the Moreau-Rockafellar subdifferential in the space 
of directed sets, i.e. 

\(7„_ 1 (n„_ 1 ,,(V((,9/W))),''*(',9/W)) Ii;Sn _ 1 >f«>2. 

Moreover, using the embedding, we can define the directed subdifferential of 
a DC function [3]. 

Definition 3.3. Let f : R n -> R be DC, i.e. f = g - h, where g, h : R n -»■ R 
are convex. The directed subdifferential of f at x is defined by 

^Dcf(x) = J n (dg(x)) - J n (dh(x)) . (10) 
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The directed subdifferential was extended to the larger class of quasidif- 
ferentiable functions in [5, 6]. The core idea of this generalization is that 
instead of DC functions more general functions are considered, whose direc- 
tional derivatives are DC (see e.g. [12, Chap. 3] and [16, Sect. 10.2]). The 
directed subdifferential is then defined via the directional derivative. 

Definition 3.4. Let f : W 1 — > R be quasidifferentiable (QD), i.e. 

f'(x;l) = 5*(l,df(x))-5*(l,edf(x)) (I e 5 n _0 

with two convex, compact, nonempty sets df(x),df(x) C M n . 
The directed subdifferential of f at x is defined by 

^QDf(x) = J n (df(x)) - J n (edf(x)) . (11) 

Since 

df(x) = dg{x) , df(x) = Qdh(x) 

for a DC function / = g — h, Definition 3.4 is an extension of the directed 
subdifferential for DC functions introduced in Definition 3.3, namely it holds 
for DC functions 

^QDf(x) = ~£> DC f(x) = tf{ X ) . (12) 

We would like to turn our attention to quasidifferentiable functions and state 
the following lemma which is a slight extension of [4, Proposition 3.15] from 
convex to quasidifferentiable functions. 

Lemma 3.5. Let f : W 1 — > K be quasidifferentiable. Then the directed 
subdifferential of f fulfills 

~3 Q Df(x) = ~3 D cf(x;-)(0). (13) 

Proof. Setting f'(x; I) = g(l) - h(l) with 

g(D = S*(iidf(x)) , h(i) = 5*(l,edf(x)) , 

we can use (7) which yields 

dg(l) = Y(l,df(x)) , dh(l) = Y(l,Qdf(x)) . 
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Proposition 4.3 applies and we can prove that 

^ocfix; -)(0) = J n (dg{x)) - J n (dh(x)) 

= J n (Y(0,df(x))) - J n (Y(0, edf(x))) 

= Udf(x)) - J n (edf(x)) = ~S QD f(x) . 

□ 

The previous result allows to carry over results on the directed subdiffer- 
ential from the DC to the quasidifferentiable functions. 

4 The directed subdifferential 
without a DC structure 

In this section we suggest a technique for constructing the directed subdiffer- 
ential only from the directional derivative, i.e. without using any information 
on the DC structure of the function and avoiding the direct embedding of 
the relevant subdifferentials. For the sake of clarity, we start with convex 
functions, then extend the construction to DC functions, and end up with 
defining a more general class of 'directed sub different iable' functions. 

Starting from the equality (9) of the embedded subdifferential of convex 
analysis, we now obtain an explicit representation of the directed subdif- 
ferential of a convex function via its directional derivatives. Here, we can 
apply (6) to see that the second component of the directed subdifferential 
in (9) equals the directional derivative. To obtain an explicit formula for 
the first component as well, we use an auxiliary function /;(■) which depends 
only onn-1 variables. 

We first gather the result for convex functions and apply the new repre- 
sentation to DC and quasidifferentiable functions in a second step. 

4.1 Convex functions 

Recall that the directed subdifferential of a convex function is the embedded 
image of its Moreau-Rockafellar subdifferential into the space of directed sets. 
We describe its construction first in one dimension. 
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It is not difficult to observe that for any convex function / : R — >■ R with 
[a, b] := df{x) we have 



f'(x; —1) = max{— v} = —a; f'(x; 1) = max{t>} = b , 

v£[a,b] v€[a,b] 

and hence, by the definition of the directed subdifferential, 

~£> DC f(x) = J x {df{x)) = 0\ = [-f'(x;-l),f'(x;l)] . (14) 

Based on this construction, we now obtain a similar representation for 
higher dimensions. Consider a convex function / : R n — > R, and fix a point 
x G R n . Let f'(x; •) be the directional derivative of / at x. To define an 
explicit expression of the first term in the right-hand side of (9) for a given 
vector / G we define an auxiliary function f : R n_1 — > R which is a 

restriction of f'(x; ■) to the hyperplane I + span {/}-*-, i.e. for y G R n_1 let 

m = f(x;l + I$_ ltl y), (15) 

where n^_ 1 1 = R^fan-i n ma P s R n_1 to span {I} 1 - . Here 7r^ ? _ 1 n maps points 
in R n_1 to R n by adding a zero last coordinate, and R~\ : R n — > R n is the 
inverse of the fixed rotation introduced in Section 2 (see (3)). Thus, 

R n}( en ) =*> i?~](span{ei,e 2 , . . . ,e n _i}) = span {l} 1 . 

In the following proposition the first (lower-dimensional) component of the 
directed subdifferential is expressed via a directional derivative of a certain 
function restricted to an affine space. 

Proposition 4.1. Let f : R n — > R be convex. Then, 



(/'(«; 0)z=±i for n=l, 

t DC fi(0),f'(x;l)) forn>2. 



Proof. Taking (14) into account, we only prove the case n > 2. 

First observe that the directional derivative f'(x; I) of a convex function 
is also convex as a function of the direction I, therefore f'(x; I) is directionally 
differentiable, and the higher directional derivatives as well. Hence, in the 
case of convex functions directional derivatives of any 'order' are defined. 
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Since / is convex, we can apply (6)-(8) and it follows that 

/i( o ; „ )=Bm MiM 

Jn ' t^o+ t 

f\x-i + ml_^u)-f'{x-i) 

= lim ■ 

i->0+ t 

= [f'(x;-)]'(l;nl_ hl u). 

Using the equality [f'(x; v) = S*(v; Y(l, df(x))) (see e.g. [5, Lemma 3.4]), 
we get 

f!(0:u) = max C T nJ i ,u 

lK ' teY{i,df{x)y n 1,4 

= max (II n _ :M C) T « 
CeY(i,df(x)) 

max £ T u = 5*(u; U n ^Y(l, df(x))) . 
?en„_ 1 , i y(2,s/( a; )) 

From here, by (6) we get Il n _i i /F(/, df(x)) = dfi(0), hence 

~S DC fl(0) = J n -l(ttn-l,lY(l;df(x))) . 

This, together with (6) and (9) implies (16). □ 

We illustrate our construction with a simple example. 

Example 4.2. Consider the function f : IR 2 — > R, f(x) = max{|xi|, \x2\}, 
and for any I G S\ let 



R 



2,1 



h k 



then R 2 ] 



k k 
-h k 



We first construct the directed subdifferential by embedding the subdifferential 
of f into the space of the directed sets as in the original definition of the 
directed subdifferential, and then show that the same result can be obtained 
via the directional derivative approach. 

Since f is positively homogeneous, f'(0;p) = f(p) for all p G M 2 ; besides 
it is not difficult to see (e.g. applying [14, Corollary 4-3.2 from Chap. VI]) 
that the grey polytope in Fig. 1(a) equals 

df = d/(0) = co{(l, 0), (0, 1), (-1, 0), (0, -1)} . 
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By equality (9) we have 

^W(o) = J 2 (df) = Mu^or^am^df)) 

It is not difficult to observe that for I G Si 



{ {(1,0)}, h>\h\, 

{(-1,0)}, /i<-|/ a | 

{(0,1)}, h>\h\, 

{(o,-i)}, k<-\h\ 

co{(l,0),(0,l)}, I 

co{(-l,0),(0,l)}, l = { 

co{(-l,0),(0,-l)}, l = { 



leSi 



Y(l,df) 



Since 

ni,i 

we have for I G Si 



^ co{(l,0),(0,-l)} 

7Tl,2^= [1,0] 



J M 

/ = f J L) 



/2 
/l 



:= Ji(IL hl (Y(l,df))) 



{-I 



2/ , 



i i 

V2' 



U , 



/l > \k\ , 

h > \h\ , 
/ 2 <-|/i| 

\h\ = \k\ 



(17) 



(18) 



The construction of the directed subdifferential is illustrated on Fig. 1. 
Noticing that by /'(O; I) = 6* (I; df), we have 



t DC f(0) = (~rJiJ'(0;l) 



leSi 



(19) 



from (17) and (18), where L^i is given by (18). 

We now obtain the directed subdifferential via the directional derivative 
based procedure. Observe that for every y G R 



" /l " 




h h ' 




' 1 " 




h + yh 




+ 









y = 


_ h - yh _ 
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(a) (*) (c) 



Figure 1: Construction of the directed sub differential via embedding of df 
(Example 4.2): a) the sub differential of / at 2 ; b) projecting the supporting 
faces onto the one- dimensional subspace ili^M 2 ) for / = (l/\/2, 1/V2) and 
c) for I = (1/2, v^/2) 



hence, 

fi(y) = /'(0; / + n?>) = /(/ + njjy) = max^ + y/ 2 |, \h ~ yk\} ■ 

An illustration of how to construct fi is given on Fig. 2. 
It is a trivial exercise to compute 



r h, 


k > 


\h 




r -k, 


k> 


\k\ 


-h, 


k<~ 


\k 




h, 


k<- 


\k\ 


< ~k , 


k> 


\k 


\ //(0;-i) = < 


k, 


k> 


\k\ 


k, 


k<~ 


\k 




-k, 


k<- 


\k\ 


i 

I V2 ' 




\k 




i 

I V2 ' 


\k\ = 


\k\ 



Applying (14) to compute d Dcfi(0) ; we observe that d dc/j(0) = T)i, 
where ~t)i is defined by (18). Therefore, by (16) 



~$Dcf(x) 



docfMJ'ix; I) 
which coincides with (19). 



rJ h f'(x;l) 



In the next section we show that the directed subdifferential of a DC and 
a QD function can also be constructed via directional derivatives, i.e. Propo- 
sition 4.1 also holds for DC and QD functions. 
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: /+nJ(R) 

(a) (b) 

Figure 2: Construction of the restriction j) of the function / (Example 4.2) 
for / = (I/a/2, 1 / \/2): a) graph of the function / which in this case coincides 
with f(0 2 ; •); b) the restriction of / to / + 11^ (R) 



4.2 DC and quasidifferentiable functions 

Assume that / : R — > R is DC with / = g — h (where g, h : R — > R are 
convex), then for any x G R using (14) we get 

^Dcf(x) = Ji(dg(x)) - J x {dh{x)) 

= l-g'(x; -1), g'(x; lj] [-h'(x; -l),h'(x; 1)) 
= [-(g'(x; -1) h'(x; -l)),g'(x; 1) - h'(x; 1)] 
= [-f( X ;-l)J'(x; lj] , (20) 

since f'(x; ■) = g'(x; •) — h'(x; ■) (see e.g. Remark 3.1). Hence, Dcfi x ) — 
[—f'(x; —1), f'(x, which coincides with the expression (14). 

Now let / : R n -> R be DC, and fix a point x G R". Let f'(x; •) be the 
directional derivative of / at x. Consider the restriction j) of the directional 
derivative defined by (15). 

Proposition 4.3. Let f : R n — > R be DC with f = g — h with convex 
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functions g, h : M. n — > R. Then, 



I (f'( x ;l))i=±i forn = l, 

*">M=it1 Bcm ,f lx . l tj) forn>2. 

/ l£S„— i 



jn— 1 



Proof. Since (20) is already proved, we only consider the case n > 2. 
By Remark 3.1 /'(x; I) = g'(x; I) — h'(x; I), and hence for any y G 

fi(y) = g\x- 1 + Ul_ 1>iy ) - h\x- 1 + nl_ hl y) = 9l (y) - h^y) . 

Since both g and h are convex, we can use the results from the previous 
section, i.e. dgi = n ri _i i /F(Z; dg(x)) and dhi = U n -i t iY(l; dh(x)). Observe 
that fi is also DC, since gi and hi are convex and = gi — hi. Therefore, the 
directed sub differential of fi at is the difference of the convex embeddings 
of dgi and dhf. 

~$Dcfi = Jn-x{dgi) ~ J n -i(dhi) 

= J n _ 1 (n n _ li ^(Z; dg{x))) - J n ^(U n . h iY(l; dh(x))) ; (22) 

moreover, 

S*(l; dg{x)) - 5*(l; dh(x)) = g'(x; I) - h'(x; I) = f'(x; I) . (23) 

Now comparing (22) and (23) with the definition of the directed subdiffer- 
ential, we obtain (21). □ 

The case of quasidifferentiable functions is a consequence of the DC case 
by taking into account Lemma 3.5: 

Corollary 4.4. Let f : MJ 1 — > K. be quasidifferentiable with 

f{x-l) = 6*(l,df(x))-S*(l,edf(x)) (I e 5 n _0 
and Of (x) ,d f (x) E C(W l ). Then, 

I if'{ x i 0)z=±i forn = l, 

V / leS„-i 
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Proof. Let ip(l) = f'(x; I), then ip(-) is a DC function. It is easy to conclude 
that 



y>(0) = /'(s;0) = 0, 
<p(hv) = f'( x 'i h v) = hf{x] rj) = h<p(r)) , 



<p'(0; r]) = lim r (</?(M - <p(0)) = <p(v) = f'(x; rj) , 



^(o) = ^'(0; i + nl_ 1>lV ) = f{x- 1 + n^.^) = /,(o) . 



Proposition 4.3 and Lemma 3.5 apply which show 




(V(0;%=±i 

i (t DC <pi(0),<p , (0;l)) 



lGSn-1 



for n — 1 



for n > 2 




for = 1, 



for n > 2 



9 QD f(x) • 



□ 



The previous Proposition 4.3 and Corollary 4.4 can be seen as general- 
izations of [4, Lemma 3.10 and Theorem 3.11] to the case of difference of 
two sublinear functions (DS) functions / : M. n — > R for state dimensions 
n > 2 and to DC/quasidifferentiable functions / : R n — > R for n £ N (in the 
additional view of [4, Lemmas 3.6, 3.8 and 3.9]). In [4, Theorem 3.11] the di- 
rected subdifferential for such functions is expressed with the limes superior 
of Frechet subdifferentials as first component and the directional derivative 
as second component (see [4] for more details). But in the latter article, the 
primal aim was to discover the connection of the Mordukhovich/basic sub- 
differentials to the Rubinov subdifferential (the visualization of the directed 
subdifferential). 

Hence, we can give an equivalent definition of the directed subdifferential 
via directional derivatives for both cases (DC and quasidifferentiable func- 
tions). Moreover, it appears that in contrast to the original definitions of the 
directed subdifferential in [3, 5], these results lead to a new definition of the 
directed subdifferential for an extended class of functions wider than DC or 
QD functions. We first need to define such functions. 
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5 Extension of the directed sub differential 



In this section, we give a definition of 'directed sub different iable' functions 
and show that a directed sub differential can be defined for such functions 
even though they are not necessarily DC (and even not quasidifferentiable). 

5.1 Directed sub different iable functions 

We define the 'directed subdifferentiable' functions recursively by considering 
restrictions of directional derivatives to affine subspaces in a recursive way. 

Definition 5.1. (directed subdifferentiable function) Given a constant 
M > 0, a function f : IR — > M. is called M-directed subdifferentiable at x £i 
if both its left- and right-sided derivatives exist and 

max{|/'(x; -1)|,|/' (x; 1)|} <M. 

A function f : W 1 ' — > K, n > 2 is called M-directed subdifferentiable at 
x G M. n if its directional derivative f'{x] I) exists for every I, is continuous as 
a function of the direction I, is bounded by M: 

max \f'(x;l)\ < M , 

and the restriction fi(-) = f'(x;l + U^_ ll (-)) : IR n_1 — > IR of its directional 
derivative to / + span {/}-*- is also M-directed subdifferentiable at 0„_i for all 
I G S n -\. 

We say that a function is directed subdifferentiable if it is M-directed 
subdifferentiable for some M > 0. 

Observe that the restrictions fi are constructed in the same way as for 
convex and DC functions above (also see Fig. 2 for an illustration). 

Remark 5.2. Even though the above definition might look cumbersome, the 
directed subdifferentiable functions are very common in applications. All 
Lipschitz functions definable on o-minimal structure (which include semi- 
algebraic functions [11, 15]) are directed subdifferentiable. Even though this 
fact is fairly obvious for anybody sufficiently familiar with definable functions, 
we provide a sketch of the proof for convenience in Lemma 5.4- We would 
like to thank Aris Daniilidis and Dmitry Drusviatskiy for providing us with 
helpful hints for the proof. 
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Remark 5.3. We would like to mention that the study of definable functions 
and their generalized subdifferentials has recently drawn much attention (e.g. 
see [8, 11, 13]). The class of definable functions is very broad, and vast 
majority of functions encountered in applications belongs to this class. This 
restriction helps focussing on results crucial for optimization theory [15] with- 
out being distracted by abnormal behaviour of exotic examples. 

The fact that locally Lipschitz definable functions are directed subdiffer- 
entiable follows from the next lemma. One needs to apply it recursively n 
times to the directional derivatives of directional derivatives to obtain the 
desired result. We only provide a sketch of the proof, as it is not the core 
result of the paper, and, as we mentioned before, the proof is evident for 
anybody familiar with o-minimal structures [10, 15]. 

Lemma 5.4. Let f : W 1 — > K be locally Lipschitz around x G MJ 1 and defin- 
able on some o-minimal structure. Then the directional derivative f'(x; ■) of 
f at x exists, is globally Lipschitz and definable on the whole space M. n . 

Proof. The existence of the directional derivative follows from the mono- 
tonicity theorem (see [7, Chap. 5] and [10, Chap. 2]). It is a trivial exercise 
to show that the function g x (y, t) : M n x (0, oo) — > E, 

is definable (it is a composition of definable functions). The monotonicity 
theorem implies that for every y G M n there exists r± > such that g x is 
monotone on y x (0, ri). Moreover, since / is locally Lipschitz around x, 
there is an r2 > such that g is bounded on {y} x (0, r-z). Hence the limit 

f'(x; y) = \im g x (y,t) 

exists for every y G M. n . 

The Lipschitzness of the directional derivative follows from the local Lip- 
schitzness of the function / around x. 

It remains to show that the directional derivative h x : M. n — > R, h x (y) = 
f(x;y) is definable. We use the argument from [15]. For any definable 
ip : M. n xi-^R, where A G MP is a definable set, the inf function 

(f(x) = inf ij)(x, s) 
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is definable (this result is not difficult to prove using the standard technique 
described, e.g. in [10, proof of Proposition 1.2]. Observe that 

h x (y) = f(x;y) = \img x (y,t) 

= sup inf g x (y,t) 
ee(o,n) *e(°» £ ) 

= sup inf g x (y,mm{t,e}) 

ee(0,ri) *6(0,+oo) 

= - inf [- inf g x (y,mm{t,e})]. 

ee(0,n) te(o,+oo) 

The function g x (y, min{£, e}) : M. n x (0, +00) x (0, +00) is definable, hence, 
h x (y) is definable as an inf function. □ 

We next show that arithmetic operations on directed subdifferentiable 
functions as well as pointwise min and max operations again yield directed 
subdifferentiable functions. 

Lemma 5.5. Let f i :M n -^'Rbe Mi-directed subdifferentiable at x fori = 1,2 
and a, (3 G M. Then 

(i) afi + j3f 2 is \a\Mi + \j3\M 2 -directed subdifferentiable at x, 

(ti) fi ' f2 is M -directed subdifferentiable at x with 

M = M 1 \f 2 (x)\+M 2 \f 1 (x)\ . 

(Hi) /1//2 is M -directed subdifferentiable at x with 

M= M 1 \f 2 (x)\ + M 2 \f 1 (x)\ 



\f2(x)\ 2 
iff 2 (x)^0. 

Proof. Let fi, f 2 : MP — > M. be Mi and M2-directed subdifferentiable respec- 
tively, 16R™ and let / = af\ + (3f 2 . Then from Remark 3.1 

ffal) = af[(x;l)+Pffcl) Viel", (25) 

and therefore 

max \ f'(x;l)\ < \a\ max \ f[(x;l)\ + \0\ max \ f 2 (x;l)\ 
< M := lalMi + \P\M 2 • 
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Moreover, (25) yields 

/i(O = «(/iMO + 0(/aMO- 

Since both (fi)i(-) and (/ 2 )z( - ) are directionally different iable, by the same 
argument as above we have 

max |//(0; y)\< M — |a|Mi + \(3\M 2 V/ £ S n _i . 

J/SSn-2 

Repeating the same argument over and over again until we reach the relevant 
one-dimensional restrictions, we prove that / is M-directed subdifferentiable. 

The proof for the rest of the cases is analogous, except for several details 
that we highlight below. 

Observe that for the product / = fi ■ fi of two directed subdifferentiable 
functions we have from Remark 3.1 

sup \f'(x;l)\ < |/i(3;) | sup |/2(z; l)\ + 1/2(2;) I sup \f[(x;l)\ 

l£S n -l ZSSn-l iSSji-1 

< |/i(o;)|Mi + |/ 2 (3;)|M 2 ; 
as we go one level down we get for each I £ S n -i 

sup |//(0;j/)|= sup |/ 1 (x)(/ 1 )|(0; 2 /) + / 1 (a:)(/ 2 )|(0; 2 /)| 

J/SSn-2 ijtSn-2 

<|/ 1 (x)|M 1 + |/ 2 (3;)|M 2 ; 

and so on until dimension 1. The derivation is analogous for the ratio. □ 

It can be shown with Remark 3.2 that the pointwise maximum and min- 
imum functions are directed subdifferentiable. 

Lemma 5.6. Let fi : R n — > R be Mi-directed subdifferentiable at x for i £ I , 
where I is a finite index set. Then the pointwise maximum function 

/max (x) = max/i(x) 

is M max -directed subdifferentiable at x with 

M max = max I Mj I, with I(x) = {i £ I \ fi(x) = f max (x)} , 
iei(x) 
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and likewise the pointwise minimum function 

/minO) = mmfi(x) 

is M min -directed subdifferentiable with 

M min = max \Mi\, with J(x) = {i E J \ fi(x) = f min (x)} . 
ieJ{x) 

We omit the proof of this Lemma, as it is analogous to the proof of 
Lemma 5.5, using the previous Remark 3.2. 

5.2 Extension to directed subdifferentiable functions 

The directed sub differential is now extended to the class of directed subdiffer- 
entiable functions in which no DC structure for the function or the directional 
derivative is present any longer. Instead, we will base the construction on 
directional derivatives only. 

Definition 5.7. (Second definition of the directed subdifferential via 
directional derivatives) Let f : R n — > R be directed subdifferentiable, then 
for any fixed i6l" the directed subdifferential of f at x can be defined as 
follows: 

(i) Forn = l let ~Sf(x) = [-f(x; -1); f (x; 1)]; 

(ii) For n > 2 let 

\ 'leSn-l 

where f] : R n-1 ->• R is defined by f t (-) = f'(x; I + 11^ /■))■ 

The next statement shows that the directed subdifferential is a well- 
defined directed set for directed subdifferentiable functions. 

Lemma 5.8. Let x G M n and assume f : W 1 — > R is directed subdifferen- 
tiable. Then the object described by Definition 5.7 is a directed set. Besides, 
if f is M -directed subdifferentiable, then 

f(x)\\ = inf{M | / is M -directed subdifferentiable at x} , (26) 
moreover, the infimum is attained. 
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Proof. For n = 1 the statement is trivial: indeed, given / : R — > R such that 
/ is M-directed subdifferentiable at x G R, we have 



— > 



df(x) = [-f'(x;-l);f'(x;l)}. 

Clearly, = max{|/'(x; -1)|, \f'(x, 1)|} < M. 

Assume now that the statement is true for n = k — 1. We will prove it 
for n = k. Consider / : R fc — > R such that / is M-directed subdifferentiable 
at x G IR fc . By Definition 5.7 of the directed subdifferential 

~$f{x) = ( /'(*; 



Observe that for every / G Sk-i the function f L is M-directed subdif- 
ferentiable, and hence by the induction assumption d fi is a directed set, 
moreover, 

0fi\\<M V/G^x, (27) 

and hence the first component of d fi in (26) is a bounded map from Sk-i 
to V^- 1 ). Further, since / is M-directed subdifferentiable, its directional 
derivative f'(x; •) is continuous and bounded by M on the unit sphere: 

sup \f'{x;l)\ <M. (28) 

From (27) and (28) we have < M. 

It is self-evident from the definition of an M-directed subdifferentiable 
function that the infimum in (26) is attained. □ 

We have already shown in Corollary 4.4 that Definition 5.7 extends the 
directed subdifferential for quasidifferentiable functions introduced in [5] and 
restated in Definition 3.4. 

We would like to point out that the difficulty to construct the 'max+min' 
representation for the directional derivative has been repelling people from 
applying quasidifferentials to solve nonsmooth optimization problems (apart 
from the problem of non-uniqueness and 'inflation' after applying calculus 
rules already addressed in [6]). On the other hand, the excellent calculus 
rules of the quasidifferential, e.g. the exact sum rule, are often not taken into 
account. Therefore, the QD representation can be gained by applying the ex- 
act calculus rules. Assuming that the function consists of (nonsmooth) outer 
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operations like 'max or min' and of (differentiable) simple inner functions, 
one can iterate the QD representation formulas from the inner functions to 
end up with the QD representation of the (complicated) outer functions. This 
idea (similar to the ideas in algorithmic/automatic differentiation) can also 
be applied for the directed subdifferential. While the directed subdifferential 
is essentially based on the same idea as quasidifferential, our approach solves 
the fundamental problem of constructing the DC representation of the direc- 
tional derivative — we simply do not need it, as we only utilize directional 
derivatives in our construction. 

5.3 The class of directed subdifferentiable functions 

We state in the following remark a list of functions classes that are directed 
sub different iable . 

Remark 5.9. The following types of functions f : R™ —> R are directed 
subdifferentiable: 

(i) convex functions 

(ii) DC functions 

(Hi) quasidifferentiable functions 

(iv) amenable (and strongly amenable) functions 

(v) lower-C^ and upper-C^ functions for k £ N 

The first three classes belong to the class of directed subdifferentiable functions 
by [5, Lemma 3.4] which states that a directional derivative of a quasidiffer- 
entiable function is also quasidifferentiable. 

(iv) follows from [5, Corollary 5.8], while (v) follows from [5, Corol- 
lary 5.4] for k > 2 and from [5, Proposition 5.5] for k — 1. In both cases 
it was shown that the function classes (iv)-(v), see the references in [5] with 
the definitions, belong to the bigger class of quasidifferentiable functions. 

Curiously enough, it appears that the class of directed subdifferentiable 
functions is substantially wider than QD. We next give an example of a 
directed subdifferentiable function / : R 2 — > R defined as 



f(x,y)= inf x 



fc£l:oo 



y 
k 
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which is not quasidifferentiable. This particular example is motivated by an 
idea of J. C. H. Pang and based on the well-known one-dimensional construc- 
tion discussed in detail in [5, Example 3.5] (see also the references therein). 

The idea presented in this example can be seen as a prototype to define a 
family of functions that are not quasidifferentiable but directed subdifferen- 
tiable. In this sense it is a universal construction to create further examples. 

To show that this function is Lipschitz, we need a small technical result 
which also states the Lipschitz constant. The proof is self-evident, hence, 
ommitted; for a more general result with upper semi-continuous parameters 
see [9, Sec. 2.8]. 

Lemma 5.10. Let fa : M. n — > R, i = 1, 2, be globally Lipschitz with a common 
constant L. Then their pointwise maximum and minimum are also Lipschitz 
with the same constant. 

Example 5.11. Let f : R 2 — > E be defined as follows: 



f(x,y) = inf 

fcSl:oo 



y 



(i) Observe that for every k G N the linear function x — y/k is globally 
Lipschitz with the constant L^ = + 1/k 2 < y/2 =: L. 

From Lemma 5.10 we deduce that for any N G N the function 

Tn[x, V) = mm x — — = mm max < x — — , — x H — > 

J V ,yJ k€l:N k k€l:N I k k) 

is Lipschitz with constant L. 

Pick an arbitrary pair of points X\,X2 G IR 2 . It is not difficult to observe 
that 

f(x,y) = lim f N (x,y) , 

iV— >oo 

therefore, for every e > there exists M G N such that 

£ £ 

l/Oi) - /mOi)| < -\\xi - x 2 \\, \f(x 2 ) - /mMI < -\\xi - x 2 \\ . 
Therefore, 

|/(a?i) - f(x 2 )\ < e||a;2-a;i|| + |/m(^i) - ImM] < (L + e)\\x 2 - Xi\\ , 
hence, 

\f(xi) - f(x 2 )\ < lim(L + s)\\x 2 — xt\\ = L\\x 2 — xi\\ , 

e4_0 
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and by the arbitrariness of Xi and X2 the function f is globally Lipschitz with 



(ii) The function f is positively homogeneous, hence, it is Dini direction- 
ally differentiate at zero with 



It follows from the Lipschitzness of f that it is also Hadamard directionally 
differentiate. 

(Hi) We next show that even though this function is both Lipschitz and 
directionally differentiate, it is not quasidifferentiable. Assume the contrary: 
then there exist two sublinear functions g, h : M? — > IR such that 



where g(-, 1) and h(-, 1) are convex functions. It is well-known (see the discus- 
sion in [5] and references therein) that the function /(•, 1) is not of bounded 
variation, hence, can not be represented as a DC function. This contradicts 
our assumption that f is quasidifferentiable. 

(iv) We next show that the function f is M-directed subdifferentiable at 
the origin with M = a/2. To do that, we state that the directional derivative 
f'(0; I) of /(•) exists for every I G Si by (ii). We need to show that 

1) the directional derivative //(0;r/) of the auxiliary function //(■) exists 
for every rj — ±1 

2) the directional derivatives f'(0;l) and //(0;r/) are bounded by M for 
every I G Si and r\ = ±1, i.e. 



We first have a closer look at the function, considering its values on different 
areas in M 2 . It is not difficult to see that 



constant L = y2. 



/'(0;0 = /(0 



VleM 2 . 




/(-,!)= inf -~ \ =y(.,l)-M-,l), 



If (0; /)| < M (I G Si) ,max{|//(0; 1)|, |//(0; -1)|} 



< M . 




x 



ffay) = { \v\ 



x\ - \y 



X 



V 



y 
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Since f'(0;l) = f(l) by (Hi), the absolute value of the directional derivative 
is bounded by M. 

The areas A and B and the areas Ck and for several initial values of 
k are shown on Figure 3. 




Figure 3: Regions on which the function / from Example 5.11 is linear 



Observe that the function f is piecewise linear in a neighbourhood of every 
point except for the line H = {0} x K. Therefore, its directional derivative 
exists and is bounded by the Lipschitz constant of f everywhere except for H , 
and hence the restriction of f to the relevant affine subspaces is also defined 
and is bounded by the Lipschitz constant everywhere onM?\H . It remains to 
show that the restriction f] of f is directionally differentiable for I e S± D H . 
Observe that S 1 nH = {(0, 1), (0, -1)}. For 1+ = (0, 1) and l~ = (0, -1) we 
have 



/!+(*)= /(M) 



inf 

fceN 



t 



/!-(*) = /(*,-!) 



inf 

keN 



t 



k 



fl+(-t) 



It was shown in [5, Example 3.5] that the function fi+ is directionally differ- 
entiable with max„ 6 /_iu |//+(0;u)| < 1 < L. We have hence shown that the 
function f is M-directed subdifferentiable. 
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